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Tne  Knapsack  problem  nas  traditionally  been  solved  by  dynamic 
programing,  though  a  mure  n.*cent  emmwrative  algorithm  by  f'«  C* 

Gilmore  ana  .n,  ,  •  Gomory  nap  proved  somewhat  more  efficient.  In  this 
paper  relations  are  dev  el  oped  w  lien  substantially  reduce  the  number 
of  solutions  wnicn  mat  be  examined  by  the  Gilaiore-oomory  method,  or  by 
any  algorithm  for  the  onnosack  problem  wnicn  uses  an  enunerative  b&ee. 
Our  roHuitvi  enable  certain  problems  for  which  tne  CJ  il  mor e-Gocaory  method 
reduces  air.ost  to  combi  ote  enumeration  to  be  solved  after  examining  only 
a  handful  of  alternative;!.  Computer  studies  tc  provide  detailed 
comparison*  of  methods  which  no  and  do  not  employ  these  results  have  not 
yet  b»«n  undertaker.. 


where  c  *  (c.j 


The  Kii&p<iiiCK  problem  may  be  written 
Maximi  ze  cx 

subject  to  ax  <  o,,  x  >  0  and  x  integer, 


c  )  and  a  «  (a,  a_ 
n  .12 


a  )  are  1  x  n  rov 
n 


vector  of  positive  constants*  b  L»  a  positive  scalar,  and  x  -  (x^  x^  x^) 
is  an  n  x  1  column  vector  of  nonnegative  integer  variables.  frequently 
(1)  ia  accompanied  bj»  an  additional  set  of  restrictions  of  the  form 
for  1  *  1,1  400  *  n«  Ir.  which  case  we  will  refer  to  it  aa  the 
bounded  varlftblc  knapsack  problem. 

Practical  application  for  the  knapsack  problem  of  soma  significance 
has  been  found  by  P»  C,  Gilmore  and  R,  E*  Gomory „  In  references  3  and  4 
these  authors  show  how  the  knapsack  problem  may  be  ueed  to  enable  cer  ain 
Xi.fK  > rograraming  problems  involving  an  enormous  number  of  variables 
to  be  usefully  handled  with  linear  programming  methods.  With  the  Introduction 
of  a  special  enumeratlve  algorithm  in  [tjj,  Gilmore  and  Goiaory  found  It 
possible  to  obtain  solutions  for  the  knapsack  problem  about  five  times 
more  rapidly  than  with  dynamic  programming*  *u>d  thereby  were  able  to  use 
their  method  as  an  adjunct  to  the  linear  programing  algorithm  to  solve 
problems  from  t!ie  paper  industry  within  reasonable  time  limits  on  the 
computer.  Nonetheless*  computation  devoted  to  solving  the  knapsack 
problems  was  a  sizable  fraction  of  total  computation,  so  thftt  improved 
algorithms  for  problem  (l)  would  seam  to  be  assured  of  Immediate  application. 


In  what  follows  we  will  firet  outline  the  enumeratlve  algorithm 
for  (1)  proposed  by  Gilmore  and  Gcmory,  and  then  by  means  of  liscussion 


and  theorems  develop  relatione  designed  to  exclude  a  substantia)  number 
of  solutions  from  consideration  when  applying  any  such  enumerative  method. 
Gilmore  and  Porno  nr s  Method. 


It  is  customary  in  dealing  with  problem  (1)  to  index  each  variable 

x,j  Ln  terms  of  its  contribution  to  the  objective  function  value,  divided 

by  the  amount  a  by  which  this  variable  occupies  a  portion  of  the 

available  "space*'  in  the  constraint  ax  <  b.  This  practice  appears  to  have 

originated  with  Dental g  ana  will  be  adhered  to  throughout  the 

remainder  of  Ur n  paper;  we  assume  o,/a,  >  c_/a.,  >  »  >  c  /a  * 

The  algorithm  of  Gi  Imore  ana  Gomcry  uses  thin  .indexing  as  the 

basis  for  a  lexicographic  ordering  of  the  solutions  to  bo  enumerated  and 

as  a  means  for  testing  when  certain  solutions  may  be  bypassed  in  the 
1 

enumeration.  It  ray  be  observed  that  the  lexicographically  largeot 

solution  x  which  satisfies  ax  <  b  is  given  by 

X-,  »  ib/a.],  tnd 

K**  * 


x  * 
k 


[{b  -  2.  a  J  for  k  -  2, 

i-l 


n. 


since  clearly  no  value  of  x^  car.  exceed  x^ ,  and  given  x^  •  Xj,  no  value 
of  x^  can  exceed  etc<?  Also,  by  defining  e  *  max(i  j  x^  +  0),  it  may 
be  seen  that  for  any  feasible  solution  x  to  (1),  the  lexicographically 
largest  solution  x  which  is  lexicographically  smaller  than  x  ie  given  by 

for  k  <  s 


x, 

A 


A 

X 


>  x,  *1  for  k  **  a 
(  ‘  „ 

y  f(t  -  l  aixj.^SJ  *or  *  "  »  ♦  1-  >*  -  ,  n 


1,  The  Gi  lav.  rv-Gomory  method  is  coupled  with  a  technique  which  enables 
a  number  of  knapsack  probltatss  having  the  same  a  and  c  vectors  to  be  solved 
simultaneously.  The  basis  for  this  technique  may  be  seen  by  noting  that 
the  cot  of  feasible  solutions  to  (1)  for  b  *  Is  a  subset  of  tlie  set  of 
feasible  solutions  to  \ i.j  for  b  > 

?.  <Vr  i.fio  the  symbol  .  j  to  d*:  "t.e  U.t  greatest  Integer  less  than  or  eou&  1  to  r. 
arwj  to  dcn.ie  the  le^rt  integer  greater  titan  or  equal  to  * 


3 


LUcept  for  the  test  which  rules  certain  solutions  out.  of 
corui.i d  ration.  the  GJlmore-Gonory  method  begins  with  the  lexicographically 
largest  x,  r.k1  then  redefLnes  x  to  equal  xy  repeating  thi*i  process  until 
there  ere  no  solutions  left  to  be  generates  io  avoid  enumeration  of  all 
possibilities,  the  largest  -/a * ue  1  of  cx  obtained  at  any  point  In  the 
process  is  uooa  to  rule  out  axami nation  of  some  oi  those  solutions  x  tor 
which  tx  <  A  Thi  *  is  accompli shod  aa  follows- 

For  any  feasible  *c  1  ut. i on  *  ,  consider  problem  (1)  subject  to  the 
additional  restriction  that  -*  x^  for  i  *  lv  ,  a,  where  a  i-j  chosen 


v.i  :  «  0  fo*-’  i  •* 


Iher.  \X)  ia  replace.-!  by 


MaxL’Dtr.e 


t.  c,x„  *•  cx 
I'*  ‘  1 


subject  to  Z  p  <  b  «  ax  * . 
l>s  ~ 

If  a  *  nt  the  objective  function  value  for  this  problwm  is  trivially  equal, 
to  ext  Otherwise,  an  upper  bound  on  the  value  of  the  objective  function 
for  (2)  ie  given  by  relaxing  the  integer  requirements  on  the  variables  x^ 
for  i  >  s.  iXie  to  the  ordering  of  the  variables  the  solution  to  the  problem 

in  thi*  case  is  cloariy  to  take  the  value  of  x  .  os  large  as  possible, 

or  x  ,  -  (b  ~  ax  )/a  ,  e  This  yields  the  objective  function  value 

cx  ♦  c^fj(b  ax  )/a  jV  which  we  will  denote  by  M*  Tnus,  given  any 

solution  x’,  a  necessary  condition  that  there  exist  an  integer  solution 
x4  sue}  that  cxf  >  M  and  x,  *  »  x^ '  for  i  <.  s  is  Just  M  >  Gilmore  and 

jL  a 

Gomory  use  Lois  fa^t  In  their  algorithm  by  dividing  the  step  which 
defires  'x  into  two  parts „  In  the  first  part  they  define  the  solution  x 
9c  that 


If  k  <  n 


'  4  C 

*  it-  '■ 


i 


where  »  *  ntax(l  |  x(  f  0/  If  M  >  M,  th*  dfflr.it  ion  of  x  ifc  conn'leted  as 
earlier »  j-nd  the  ex  u/rinratiori  prc  ce:t ,  continues  ui  interrupted .  But  If 
ft  <  M,  all  solutions  whlcn  apvree  wl  n  a  In  the  f„rat  e  components 
(jLnc*la>i ixiij  jl)  <nr.y  clearly  nc  Ifsiorvc-  Tiiua  lr*s  n«nxl  step  of  tr.e  enumeration 
would  be  to  v  otaln  the  n«w  <  which  Is  t  h»  lexicographically  largest  solution 


lexicographically  s.-aailer  than  x".  But  in  fact  the  nee  x  cannot  agree 
with  x.'  in  ito  first  a  -  1  components  (a  still  defined  relative  to  the 
previous  x),  since  then  x  must  be  smaller  than  x*  In  the  eth  component, 
and  the  test  ft  >  H  would  clearly  be  failed  again.  (H  cannot  increase 
until  x. H  is  iiicreaseu  for  at  least  one  i  euch  that,  i  <  s.)  Thus,  when 


*g  is  immediately  set  equal  to  0,  and  the  vector  1  is  defined 


relative  to  this  latter  x 


In  conjunction  with  their  algorithm,  Gilmore  and  Goaory  use  a 


preliminary  trinr.lng  technique  which  throws  sway  a  number  of  the  problem 
variables  before  enumeration  begins.  Whenever  c,  •  c,,  one  of  the  two 
variables  or  Xj  may  be  discarded,  depending  on  the  relative  si  see  of 
and  a^0  Thus  for  Cj  -  Cj  and  a^  <  a^,  the  variable  x^  may  be  dropped 
since  it  may  always  be  replaced  cy  in  any  optimal  solution.  While 
Gilmore  and  Go.no ry  note  that  such  an  equality  of  "prices "  would  not 
normally  be  expected,  they  found  it  to  occur  with  sufficient  frequency 
In  W.e  ii  obi  *ai*  the/  exam  ned  to  cause  the  average  size  of  these  problems 
*.o  to  reduced  from  10  to  18.2  variables , 

;  le ii*t  1  2*2 9_ i2£-? *1  I^-Prov'Xl  Algorithm 

In  this  section  wo  will  consider  the  more  general  form  of  problem  (1) 


’ 


. 


in  which  x,  <  for  i  »  1,  - 


,  n*  where  the  a„  are  assume  \  to  be  integer 


When  >  Cb/AjJ,  will  we  continue  to  refer  tc  x<  a?j  "unbounded."  It  is 
fivident  that  the  lericc- graph! rally  large:  t  feasible  solution  x  t.o  (1) 


ne  will  adhere  to  t  he  convention  that  x  will  always  be  <1 8 fined 

ae  above  relative  to  any  given  x-  We  will  ."Iso  follow  the  contention, 

unless  specified  otherwise,,  that  x*  will  be  defined  as  in  the  preceding 

section  to  be  tie  same  ns  x  except  In  the  sth  component,  in  which  case 

x  *  x  -  i.  h  already  noted,  any  solution  lexicographical ly  smaller 
a  a 

than  x  mujt  agree  with  x*  in  the  first  a  component 8. 

Tho  proofs  of  tne  thaorwas  to  follow  are  given  in  the  appendix- 

'1  hoorem  1 .  I  f  tho  re  exist  nonnogative  integers  such  that 

(i)  \  >  Q<  (ii)  1  htc  >  he,  (lii)  l  h  a  <  ha,  and 

i/k  ‘  j./k  11  ' 

(iv)  Kb  -  J  r  hj  <  for  all  i  such  tint  f  0  and  1  /  ic^ 

then  there  exists  an  apt  fail  solution  x*  to  (lj  in  which  <  h^- 

Moreover,  if  1  h.c,  >  h,  e,  *  then  x,  *  <  u,  in  every  optimal  solution 

u'l,  1  *  lc  *  K  * 

x*  to  (1).  ' 

Whon  h  -  1,  Theorem  1  gives  a  somewhat  stronger  critorlon  for 

1C 

ruling  variables  out  of  consideration  than  provided  by  the  fi  rtuitous 
coalition  c4  **  .  Dnc?  of  the  simpler  wayo  to  exploit  tne  theorem  when 

*  r«  Xj,  are  -.nbouiiiec  !:->  to  dre-p  x  whenever  an  i  exists  suoh  t*i»t 

4 


<‘C j/ Ci'><1a  —  aj°  bukst&nbial  reduction  of  the  space  of  solutions  to  be 
enumerated  may  also  be  effected  by  using  the  theorem  to  provide  more 
restrictive  upper  bounds  for  some  of  the  problem  variables-. 

Kxatnp.lo.' 

Maximise  *  lOx^  ♦  8xj 

subject  to  67^  *  2*2  *  7x^  *  }x^  *  4»'^  ♦  6x^  ♦  5Xy  <  79 0 
For  thin  problem  in  unbounded  variables,  x,  may  be  used  to  rule  out  fell 
variables  except  a»«  x^,  using  the  relation  <c  yc ^>a j  <  a^.  In  addition, 
x0  3  and  x,  v  1  are  implied  by  the  coefficients  of  and  x^%  respectively. 

We  observe  that  any  theorem  concerning  problem  (1>  applies  also 
to  problem  (I?)  of  the  preceding  section,  with  i  restricted  tx>  i  >  8, 
b  replaced  by  b  -  ax.1*  *  etc.  Thus  when  the  are  too  aaall  to  permit 
extensive  use-  of  Theorem  1  bef  the  enumeration  begins,  it  may  be  noted 
that  more  fruit  Ail  results  m*.y  a  available  when  [  (b  -  ax  )/a^3  becomes 
closer  to  In  this  case,  certain  variables  may  be  "temporarily"  ruled 
out  of  consideration  7 

The  next,  three  theorems  present  additional  ways  of  uncovering 
restrictions  on  the  x*  wheii  e  feasible  solution  is  obtained. 

X 

Theorem^?  For  any  feasible  solution  x,  and  for  any  q  ouch  that 
ax  *  >  b,  let  Pq  -  fi  |  i  /  qr  <*/«*>  <  \  "  \  *  U  -  aqV 


Then  ther«»  exists  an  optimal  solution  x*  such  that  (i)  x  *  <  x  ,  or 

q  -  q' 

(li)  X  *  <  x,  for  at  least  ore  i  such  th.it  if f  P  .  If  in  the  definition  of 
i  1  q 

’  »  fc  /c.  )  ♦  1  replaces  <c  /cs>«  then  (i)  or  (il)  must  hold  for  evsnr 
q  a  y  q  1 


F 


q  q 

0 pt ia&l  solution  x * r 


1.  A  simple  way  of  keeping  track  of  such  temporary  restrictions  is  given 
by  the  author  in  C5i«  whore  more  flexible  enumeration  procedures  than  the 
lexicographical ly  decreasing  solution  sequence  are  also  presented,  olmllai 
procedures  are  also  employed  by  isgon  Balsa  in  the  prior  article  Cl'-. 


7 


One  of  the  uses  of  Theorem  2  in  as  follow**  Suppose  a  feasible 

sol  ot.ion  x  ia  obtained  at  any  point  in  the  enumeration  process  for  wldch 

ax  ♦  a  >  b  and  x*  -  0  for  i  i  P  Then  it  Immediately  follows  that 

q  1  q 

x  *  *  0  in  eo;.ie  optimal  solution  x*,  ana  hence  the  variable  x  ranv  be 

q  Q 

dropped  from  the  probJ*fii„  Similarly,  when  a  >  a  >  0,  And  the  same 

conditions  a3  above  otherwise  obtain#  x  may  replace  a  to  provide  a  more 

Q  ^ 

restrictive  up>>er  bound  or  x_ - 


Example. 
Maxi  ml  ze 


13x,  *■  1.7x,.  *  19x. 


z6x,  *  ICiX.  4  '.2x,  *  Yfxn  ♦  li*x0 

**  >  o  7  » 

7x/  *  5x^  *  4x,  *  oitp  •  j  <•  &3 


)X^  *•  «  4  /A^ 

subject  to  3x^  4  4*^  4  Sx, 

and  •  5  for  all  l, 

Fo”  this  example,  a  feasible  aoJutl  '«  is  given  by  x,  *  '»  for  1  <  3,  and 
*  0  for  i  >  3>  Hence,  applying  Theorem  2,  it  follows  that  x^«  x^>  and 
may  be  eliminated  from  consideration  in  solving  for  the  optimum. 

Theorem  3*  For  any  feasible  solution  x  in  which  there  exists  a  component 
x  >  0#  let  J  •  f  1  I  1  /  p,  <*»/*>  <  aD  -  X-  *  * »  <«./c  >•_  <  a,  ?  - 

r  r  '»  *  r  r  r  *  r  H  ^ 

Then  there  exists  an  optimal  solution  x*  in  which  (i)  x  +  >  x  or 

p  •’  p 

(ii)  x^*  >  x^  for  at  least  or.e  i  such  that  i  /  If  in  the  definition 

of  2  ,  <.c./c*  >  is  replace!  by  lC./z  J  •  1«  then  (lj  or  (ii)  holds  for 

P  1  p  1  q 

every'  opta  uSl  solution  x*  to  (Do 

Theoreu  3  1»  very  nearly  a  reverse  Image  of  Theorem  2,  One  use  for 
this  theorem  occurs  when  a  feasible  solution  x  is  obtained  for  wldch 
x  >  0  and  for  i  i  2^t  (except  possibly  for  i  *  p).  The  problem 

may  then  be  almpll fled  by  replacing  with  the  r.ew  nonnegative 


integer  variable  x  »  x  ~  x  ,  whirr  ha«  the  up.  cr  bound  a 


x  - 


Uf 


a 


x  «  3.  *  hen  z  may  of  cau:~2t!  be  Jrc>p.»d ,  J  A  recond  -sc  is  givrn 

i  KN  ■  *  4 


/' 


P 


8 


by  the  following  corollary-. 

Corollary  to  Theorem  3»  Lot  x  be  a  feasible  solution  for  (1),  arid  let. 

8  •  ma-iid  j  Xj  /  0).  Then  x  is  optimal  if  (ij  >  'o  -  ax  for  1  >  s, 

(ii)  xL  •  for  i  <  s,  and  (iil)  for  each  i  and  p  such  that  p  <  s,  i  >  s 

cp  >  ct  and  a^.  < 

Example. 

Maximise  llx^  ♦  llx^  *  *  10x^  *  8*5  *  9x^  ♦  6x^ 

♦  Lx  ♦ 

5 

*L  -  30  6  5  5  7  3  5 

Applying  the  corollary  to  this  problem  rovoalo  that  the  solution 

x  obtained  by  setting  x^  ««  for  i  <  4  and  x.^  »  Q  for  i  >  4  is  optimal , 

Xi.  is  to  be  noted  that  the  corollary  pro  ride  a  a  sufficient  condition 

for  the  lexicographically  largest  feasible  solution  to  (1)  to  be  optimal. 

/\  M 

V.'i  <  x  replaces  x  in  the  enumeration  process,  by  extension  the  corollary 
may  also  be  used  to  give  u  sufficient  condition  that  x  is  optima)  from 
among  those  which  agree  with  x  in  the  first  a  components,  providing  a  mean*' 
for  shortcutting  the  enumeration  when  the  proper  conditions  obtain. 

A  theorem  of  a  somewhat  cifferent  nature,  'out  which  may  also  be 
U3od  to  identify  an  optimal  solution,  cr  prescribe  bounds  for  certain  of 
the  x, ,  io  as  follows. 

4 

Theorem.  A  Lot  x  ana  s  bo  given  as  in  the  preceding  corollary*  and  let 
q  be  any  subscript  greater  than  a*  let  G  b  -  axp  and  let  h  be  a  poeltiv* 
integer  such  tnat  a  >  G/h.  Then  if  c  /(a  -  G/h)  <•*  c  /a  ,  there  «xi  «tf 
an  optima)  solution  x*  such  that  (i)  x^*  <  h  or  (iij  x^*  >  x ^  for  at 
least  one  i  such  that  i  <  nt  If  e  /(a  -  G/h)  <  c  /a  »  then  (i;  or  (11) 

**  Q  CJ  0  0 

holds  ‘'or  ail  optimal  solutions  x *  to  (1). 


*  ^*7  -  82 


subject  to  2x^  ♦  4*^  * 


4x. 


Example* 

ilojcunire  SOx^  *  106*„  •  57x^  ♦  IOJ>x^  «  70x^  -  u')x^  ♦  97 ♦  85>Xg 

subject  to  lOXj  ♦  lJ*Xp  *  Hx,.  ♦  1 <  )<2jc^  *  ?x^  *  ♦•  lbx^  <  330 

nnc  *  *•  6  for  all  i  * 

The  feasible  solution  for  this  pro bleu  obtained  by  setting 

x  *■  a,  •  3  for  \  <  one!  xv  *  0  for  i  *  a,;  yiela*  a  value  fo"  G  (*  h  -  ax 

of  Ur,  To  find  the  siost  restrictive  bounds  on  the  x  fo’*  a  "  U  which 

car i  be  derived  from  thiseolut Lor  ,  w:  v/irh  to  minimize  h  for  each  such 

var  able,  subject  to  the  reatriction*  of  the  theorem*  Thus  for  each  q  >4 

it  may  be  readiiy  verified  that  the  best  value  of  h  is  given  by 

h  **  cuu(  [G/n  ]  *  2,  <c  u  {*:  a  c  a  >)  This  vie  id*  values  of  h  for 

q  a  j  q  q  a 

x  through  x,  of  2 *  4*  I*  2,  reeptrt  Ively  rk-n«e,  upper  bounds  for  these 
U 

vnriab  eo  are  1,  3»  0,  ). 

The*  next  Lheorsm,  while  intuitively  evident*  is  extremely  useful 
for  ruling  solutions  oat  of  eras  1  aeration  wlr»n  the  x  are  bounded 
Theorem  5*  Lot  p  denote  trie  greet* at  integer  each  that 


1  a. a,  «  b 
,  ,  li  - 

1  <  p 

Then 

an  optwa  L  uolutlon  x*  to  (1)  whoa  the  x^  are 

n  >t  rcqul  r  od  to  be 

Integer  13  given  by 

h 

S' 

/  a 

-»  \ 

for  1  <  p 

X 

1 

f 

U 

for  1  -v  p 

x  ‘  ** 

V 

(b  - 

l  «,a  )A 

1  <  P  ' 

An  firmed  late  consequence  of  Theorem  *?  la  that  it  provides  a 
9  mrpsr  t-*yt  Ilian  the  condition  M  >  'e  when  the  are  bounded*  i*ut  this 

i, iso  time  when  the  x^  ir*  unbounded,  o  nee  in  problem  (yj 
xa  %  I  (b  ax  •  )/hj  J  for  1  >  s  By  Theorem  jt  an  optimal  fractional 


i  ,  The  apeclal  case  of  this  theorem;  hr:  which  ci,  -  \  for  nil  1  is  duo  to 
Dan:  z lg  [•-'!» 
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solution  x*  to  problem  (2)  when  the  are  unbounded  is  Just 
/0  Tor  i  >  a,  i  /  t,  i  /  u 

'i*  *  ^  f  (b  ~  axr’  )/ai  J  for  i  *  t 

V  (b  -  ax  afx^*)/«j  for  i  -  u 

where  t  and  u  are  the  two  smallest  i,  i  ^  t,  for  which  <  b  -  ax'  (t  <  u). 
More  generalxy,  Thcoro*.  5  .viy  be  applied  in  this  fashion  when  the 
variables  are  bounded  oy  substituting  3^  •  win(  f.(b  -  ax }  )/&^  ] ,  )  for  9 

restricting  l  to  i  >  ee  ana  replacing  b  by  b  -  ax‘*>  If  we  denote  the 

optL.ial  objective  function  value  fox*  (2)  obtained  by  Theorem  5  under 
the  t  stipulations  by  4%  then  the  condition  M*  >  M  is  in  general 
stronger  than  3  >  M*  and  must  be  satisfied  if  there  exists  any  feasible 
(integer;  solution  x.  such  tlvit  <sx  >  M  and  x^  *  x^‘  for  i  <  s. 

However,  U»  tent  M*  >  M  lias  a  Had  tat  ion  not  encountered  by  the 
test  &  >  Mo  The  best  one  can  go  in  the  enumeration  process  when  M*  <  M 
is  to  redur.e  tie  value  of  x  by  )—  and  then  retest  to  aee  if  it  can  be 

R  * 

reduced  further— before  defining 'x  in  terns  of  x.  This  contrasts  with 

the  ability  to  icx.eci  lately  set  x^  equal  to  0  when  8  <  M> 

On  the  other  hand}  If  Theorem  5  is  applied  relative  only  to  the 

bounds  ,  then  the  objective  function  value  ao  obtained  (cell  it  5)  yields 

a  test  which  enables  x  to  be  handled  as  with  the  test  A  >  M-,  The 

s 

difference  between  the  power  of  M  >  H  arid  8  >  M  should  be  reaoily  apparent 
when  the  i,  are  1 halting* 

w 

It  should  further  be  noted  that  the  test  M  >  M  prescribes  a 
significant  shortcut  in  the  enumeration  process  when  x  f  •  a  „  To 
show  this  It  must  first  be  observed  that  no  test  is  applied  whan  x^*  * 
ir  tie  (11  lino re -Go.no ry  algorithm,  since  (in  addition  to  the  fact  that  the 
author?  do  rid  consm*»r  boui  tied  variables  x  i«  always  uefined  so  that 

*  x  vnf.rr*.  test  in,  '*  will  outline  a  ^et.iiou  labor  in  which 


this  limitation  is  absent,  Kur  the  moment,  however,  assume  that  a  step 
exists  at  which  x’  in  defined  to  equa*  x,  ana  the  next  vector  to  be 
to  and  is  constrained  to  agre*»  with  x,f  in  its  first  s  components*  The 

»  *m. 

test  W  >  ;  -!  is  thus  applicable,  ano  if  it  is  failed,  all  x,  for  which 

* 

w  <  i  <  s  nay  b“  set  equal  to  0,  where  w  *  m;ix(i  f  1  <  a  -  1,  /  a^j). 

The  reason  for  this  is  that  the  test  A  >  M  must  continue  to  be  failed 
as  long  as  no  x^s  is  increased  in  value  for  1  v  a,  fhe  upper  bounu3  on 
the  prevent  such  an  increase  in  trie  x^'  until  x  and  x'  are  redefined 
and  a  new  value  of  s  is  determined  satisfying  •  <  v«  This  is  accomplished 
for  either  definition  of  x‘  above  by  setting  -  0  for  w  <  i  <  s. 

The  foregoing  rule  In  fact  applies  when  x*  f  a  .  To*  then  v  •  s  1,  ana 
x  is  set  equal  to  0  in  accordance  with  the  observation  that  x  ,  and  hence 

O  n 

x  ’ ,  cannot  increase  in  the  lexicographically  decreasing  solution  sequent • 
until  same  x^  in  decreased  for  i  <  i. 

When  the  problem  is  structured  so  that  continuous  solutions  and 
discrete  solutions  yield  much  different  values  for  the  objective  function, 
it  is  sometimes  possible  to  get  a  sharper  test  than  provided  by  either 

m 

M  >  M  or  M  >  M  simply  by  keeping  track  of  information  generated  in  the 

enumeration o  The  key  is  to  take  advantage  of  the  fact  that  the  value 

of  s  upon  which  problem  (2)  is  based  will  be  duplicated  a  number  of  times. 

If  at  some  j»int  in  the  enumeration  b  -  ax  is  no  larger  than  at  an 

earlier  point  when  (2)  was  define a  relative  to  the  same  s,  then  any  bound 

on  lex.  obtained  for  the  earlier  problem  is  an  upper  bound  on  iris 
i>s  1 

expression  for  the  present  problem.  The  moat  restrictive  permissible 
bound  is  of  course  given  « i 1 1  er  by  the  best  feasible  solutlor  found  for  (2; 
or  by  the  largest  value  of  M*  for  which  the  test  M*  >  A  was  failed. 

In  spite  of  tr«  utility  of  the  foregoing  restulis,  there  are  many 


u 


! 

problems  which  require  the  application  of  additional  relations  if 
they  are  to  be  solved  at  all  efficiently.  In  fact,  one  can  readily 
find  problems  for  which  the  procedures  presented  so  far  can  scarcely 
improve  upon  complete  enumeration.  For  n  very  simple  example*  consider 
the  following. 

Example. 

Maximize  SOx^  ♦  ?0x  ♦  81x^  ♦  60x^  ♦  55x^ 

subject  to  43Xj  ♦  1*2x2  *  50jLj  ♦  i.lx;  *  <  115 » 

where  the  x^  are  unbounded. 

It  can  readily  be  shown  that  for  this  problem  the  Gi lnore-Gomory 
algorithm  will  have  to  enumerate  all  but  two  of  the  entire  range  of 
feasible  solutions,  The  test  M*  >  H  ruled  out  a  few  of  these  solutions 
but  still  requires  examination  of  an  excessive  number  of  alternatives.1 
To  remedy  thin  situation,  it  is  useful  to  introduce  the  sets  Sq,  S^,  S^,  ..  * 

where  wo  define  5^  -  »|  [b/a^]  *  k^»  Then  the  following  theorem 

and  its  corollary  allow  the  foregoing  problem  to  be  solved  by  enumerating 
only  a  single  solution,  and  provide  a  principle  which  can  be  used  to 
marKediy  rouuce  the  number  of  solutions  enumerated  in  more  complex  problems 
Theorem  6^  Assume  that  i  *  3.  for  all  1,  and  let  3,  -  max(a  ,  [b/a.  3). 

*  1  -  -  K  111 

Define  a  oubacrlptea  indexing  so  that  c.  >  c,  >  . >  c.  ,  and  let  p  be 

h  2  ~  n 

the  largest  index  for  which  13.  v  H,  where  H  -  min(k,  £  3.). 

.1  -  P  \1  i  <  n 

Then  the  optimal  solution  x*  to  (l)  is  given  by 


I.  Fortunately,  the  example  is  simple  enough  that  not  many  feasible 
alternatives  exi^t*  However,  far  worse  examples  can  easily  bo  constructed. 


.u 


Tor  .1  <  p 
0  for  j  >  p 


L  fl* 

J  <  p  ‘J 


Corollary  to  .hearem  6.  Assume  that  the  a.  are  unbounded,  ana  that  i  r  ^ 

“  ^  ‘  r  r  1  '  J  1  ti 

for  all.  i.  Further  1«  t  c  -  max(c  )«  Then  the  optimal  solution  x*  to  (i. 

q  i 


is 


(  k  for  i  * 
1^0  for  i  / 


q 

q 


From  the  corollary  it  can  ba  i.’i.edic'itely  seen  th?t  the  optical 
solution  to  the  forego ixig  problem  Is  obtained  by  setting  x~  *“  *>  In 
most  problems  ono  wou  Id  not  expect  the  condition  i  £  to  be  mot  for 
ail  lc  However,  advantage  can  be  taken  of  the  preceding  theorem  by 
noting  that  the  seta  30,  3,*  form  a  natural  partition  of  the  i  for 

i  <  n.  Clearly  we  can  find  the  opt!  al  solution  to  (1;  under  tl  e 
restriction  tnat  >  0  only  if  i  t  Having  done  so  it  follows  that 

if  a  bettor  solution  to  (i)  exists,  then  x.  >  0  for  at  least  on©  if  $. 

«A  ^ 

Thus,  in  the  enumeration  process  ail  solutions  may  be  ignored  which 
involve  >  0  only  for  i  c  3^.  J’his  of  course  applies  at  each,  stage 
of  the  enumeration,  for  Theorem  6  may  be  as  well  stated  in  terms  of 
problem  (2):  that  io,  if  3^  »  ^i  |  L(b-  ax  y/r^  ]  *  k  ?  , 

3^  *  irdn(cijf  C (b  ••  ax  and  if  all  inoicen  i  are  restricted  tc  i  >  t, 

then  the  solution  3oeciflcd  by  the  theorem  is  optimal  for  (lj  subject  to 
th?  restriction  that  <,  ’  *  x4  '  for  i  <  3 

▲  1m 


To  Illustrate  sped fically  hov  U  is  information  may  be  exploited, 
suppose  that  the  enumeration  process  ia  banco  uj/on  a  lexicographically 
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decreasing  sequence  of  solutions  as  with  the  Gilmore-Gomory  metlod*  Let 

x"  Ik?  define.*  in  terns  of  *x  as  earlier  (i.«.,  x  '  »  x  -  1  and  x*  ana  x 

3  s 

agr  in  all  other  components and  let  r  -  nolxi ( I  j  i  >  a  and  Aj  <  b  -  ax'). 

Supp  sc  r  r  S  ,  where  S  is  defined  relative  to  problem  (2)  (replacing 

i»  by  h  -  ax’*  etc.*  in  Theorem  6).  Under  the  assumption  that  tne  test 

!’  >  M  I?  passed,  apply  Theorem  6  to  find  the  opthoal  solution  to  (2) 

under  the  restriction  that  x4  ->  0  only  if  i  r  S  ,  Then  t.o  find  a  better 

solution  w :?  next  seek  the  lexicographically  largest  x  such  that 

x,  "  x.  for  i  •  s  and  x.  >  0  Hr  at  least  one  1  such  that  1  4  f>.  * 

i  1  ~  1  k 

This  solution*  which  wo  denote  by  x,  is  given  as  follows. 

Let  L  «  ruin  (a  |  :  >  r,  1  4  S  )„  If  L  ie  not  well-defined, 
x  does  not  exist  and  the  optlaai  solution  to  (2)  is  given  by  Theorem  6* 

Otherwise* 


x 


i 


/  x,  r  for  I  <  8 

( 

i-1 

\  ain(a.  v  ( (b  - 

1 

/  A 

.1-1 

( 

i-1 

^.vdnfa^,  £  (b  - 

l 

AjXj  -  L)/aj.))  for  »  *  1  <  i  <  q 

a  )/a^  ])  for  i  >  q 
1-1 


where  o  *  min (i  j  l  >  r,  i  /  S  ,  and  a.  <  b  -  E  a.x.),  i,e., 

K  1  j-1  *  J 

M 

q  in  '’fiJscc  v-red"  in  the  process  of  assigning  values  to  the  x^. 

redefining  x  to  te  equal  to  x  instead  of  equal  to  x  when 
the  tco*  s  arc  pissed  and  the  optimal  solution  io  found  on  S^y  oegmenta 
of  tie  sold, ion  space  which  might  otlerwisc  be  enumerated  can  thus  be 
bypasueo  In  the  previous  example  problem,  If  a^  •  39  ia  replaced  by 
d  *  j8*  the  corollary  to  .'heorem  6  no  longer  applies  arx,  w<*  still  nnv*» 

*  situation  in  which  the  GiLuore-Gomory  algorithm  enumerates  nearly  every 
faaaibi#  volution.  However,  ny  using  the  enumeration  procedure  Jn  which 
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& 

x  la  followed  by  xf  only  6  solutions  need  to  be  examined. 

Theorem  6  will  of  course  have  le3s  application  in  those  problems 

for  which  H  is  more  often  equal  to  h  0.  tnan  to  k,  a  situation  that 

1  <  n  1 2 

may  occur  if  the  are  small  and  the  a^  cover  a  wide  range  of  sizes. 

For  the  problems  in  which  Theorem  6  does  prove  useful*  however,  it  may 

•w  • 

be  preferable  not  to  follow  x  with  x  immediately,  but  to  generate  only 

»  ■>  ,, 
the  first  nonzero  coinjjonent  of  x  for  1  >  a  (call  it  x.),  and  redefine  x  and 

;*1'  so  th^.t 

(  x1  for  1  <  h 

x *  )  and  x  -  x . 

a  (^0  for  1  >  h. 

The  teats  A*  >  M  and  M  >  F  may  then  be  reapplied  *  and  if  they  are  passed , 

•»  M  1 

the  new  x  to  follow  the  current  x  determined  in  its  first  h  components, 

In  addition  to  giving  the  tests  more  extensive  application,  an 
advantage  of  this  procedure  Is  the  ability  it  affords  to  skip  examination 

m 

of  those  solutions  which  lie  between  x  and  x  at  each  level. 

To  give  a  clearer  idea  of  how  the  foregoLig  procedure  might  be 

incorjwrated  into  an  enumorative  algorithm,  we  diagram  such  a  procedure 

•  ? 
ne 


1  Likevdoe,  in  the  Gilmore- Como ry  algorithm  It  would  sometimes  seem 

to  be  preferable  to  reapply  the  test  M  >  M  as  successive  nonzero  components 
of  x  are  generated.  A  simple  decision  rule  for  this  situation  would  bo 
to  establish  a  number  f*  (b  >  0)  and  reapply  the  test  R  >  M  for  successive 
components  of  x  only  if  M  <  6  *  M  Similar  remarks  apply  to  testing 
K  >  M  and  M*  >  M,  It  should  be  noted,  however,  that  replacing  x  by  x  may 
significantly  change  the  test  situation,  so  that  the  decision  rule  in  this 
case  might  need  tc  be  more  complex  to  be  effective. 

2  Without  the  inclusion  of  additional  rules,  this  procedure  can  be  applied 
oiJv  with  difficulty  to  the  simultaneous  solution  of  several  knansack  problem* 
in  the  manner  outlined  by  Gilmore  and  Go mory .  The  reaeon  for  this  is  that 
the  solution  x  defined  relative  to  b  -  b* ,  unlike  the  solution  x.  is  not 
always  lexicographically  greater  than  or  equt-1  to  the  solution  x  nefined 
r«Iat  i  ve  uo  o  <  b*  <, 
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If  s  is  well-defined  for  th«  current  x,  let 

•  x^  for  i  /  «i  and  x8*  •  x#  -  1,  and  redefine 

x  ao  that  x  *  x*  •  If  e  is  not  well-defined, 
terminate  #  The  current  value  of  M  is  the  optimal 
objective  function  value. 


1.  The  definitions  of  e,  r  and  Sk  are  those  used  in  defining  x  above,  and 

the  definition  of  v  is  given  in  the  dieuesion  of  fi<  The  tests  R  >  M  and 
M*  >  M  are  applied  to  x*  as  it  is  specifically  defined  in  the  algorithm. 


The  purpose  of  the  foregoing  diagram  is  of  course  solely 
illustrative.  It  is  not  to  be  construed  as  a  representation  of  a 
highly  efficient  algorithm*  since  it  makes  no  use  of  many  of  the  results 
of  this  paper,  and  fails  to  employ  rules  for  avoiding  computational 
duplications  or  for  bypassing  the  tests  when  they  are  ui.  -ely  to  yield 
results. 

In  addition  to  the  procedure  outlined  in  the  diagram,  other  more 
refined  results  may  also  be  derived  from  Theorem  6.  For  example,  suppose 

m 

that  the  test  M  >  M  is  applied  under  the  provisional  assumption  that 

x_  *  k  (rc  S.  )  and  x.  *  0  for  i  a  S,  ,  i  /  r,  where  r  is  defined  as 
r  ic  i  k 

above.  If  the  test  is  failed,  it  follows  that  for  any  optimal  solution 
x*  to  (2) ,  x.r*  <  k  or  Xj’  ■  0  for  all  i  i  For  suppose  that  xp*  •*  k. 
Then  in  order  to  satisfy  ax  <  b,  Xj*  *  0  for  all  i  I  except  i  *  r , 

But  >  0  for  i  i  is  then  impoesib  le,  since  the  test  M  >  H  was 
conducted  under  precisely  these  assumptions.  Moreover,  the  failure  of 
the  test  implies  that  if  i  replaces  r  in  the  test  for  any  i  c  Sfc,  i  >  r„ 
the  test  will  continue  to  be  failed  &o  long  as  <  ap,  .tore  generally, 

there  can  be  no  assignment  of  values  to  those  x^  for  i  €  and  i  >  r 
which  yields  Z  a^x^  <  kap,  where  the  surouation  is  over  i  c  S^,  i  >  r« 
The  fact  that  >  0  is  required  for  At  least  one  i  i  still  holds 
(provided  the  optimum  on  has  beer*  found),  and  may  be  used  to  develop 
still  further  restrictions. 

Conclusion. 

The  objective  of  this  paper  has  been  to  develop  relations  which 
may  be  used  to  improve  tho  efficiency  of  algorithms  for  the  knapsack 


pro  bleu  o  Hen-alts  derived  have  oe*  n  illustrated  principally  In  ter.nn 
of  a  lexicographically  decreasing  solution  sequence  such  as  employed 


by  Gil.no  re  and  Go;aory,  nlth  ugh  we  have  shown  tbit  it  car.  bo  advantageous 
to  depart  fro-i  the  way  In  which  Gil  .ore  vri  (Joiaory  define  consecutive 

— -  m. 

noluti«.  ns:  e<,  g.t  ouploylng  1'heoro.u  6  ana  following  x  with  x  ioetona  of 
x  aiKec  it  possible  to  solve  certain  problems  after  exairdning  or. ly  a 
l  ruction  of  the  alternatives  enumerated  by  Gilmore  and  Go «.ory,  Although 
our  resuLts  .cay  be  used  in  a  variety  of  ways,  the  actual  design  nf  & 
specific  algorithm —  except  lor  purposes  of  1  lluotration — has  r.ot  born 
uncert  iKeru^ 


u  For  h  specific  alg  rithn  which  d e '1  a  *tll  the  integer  progrircaing 
problem  cure  genera  Uy ,  ana  which  i."  base*!  ir:  put  on  ft  cults  f.-una  in 
th  3  paper,  ee  . 


APPENDIX 


Proof  of  Theorem  I.  Suppose  that  x,  *  *  p  >  h.  for  some  optimal  solution 

K  K 

x*  to  (Do  Then  x.  *  <  t(b  -  pa,  )/a.]  for  each  1  4  k-  Define  q  v  Ip/h,  J, 

J  *"*  K  1  K 

and  let  x,^  *  xk*  ~  qh^,  and  x^  «■  x^*  ♦  qh^  for  i  /  k.  Thus  0  <  x^  <  h^j, 

ana  clearly  cx  >  cx*  and  ax  <  ax*  by  (il)  arid  (iii),  hence  x  ia  optimal 

provided  for  i  f  r.  This  ir.  assured  provided 

l(b  -  paK)/a1J  ♦  qh^  <  for  f  0  and  i  /  k»  V.hcn  p  -  1,  p  >  >  0 

Implies  q  "  l  find  the  above  relation  holds  by  (iv).  In  general,  we  note 

that  >  h^/hk  by  (ill),  and  since  p/l^  >  (p/l^j  *  q»  it  follows  that 

(p  >  <P  “  hk)^-/hk  >  hj  Adding  b/*A  •  hj  - 

to  the  first  and  last  expressione  yields 

(b  -  hkakV«l  4  hj  >  (b  -  pa  )/ftj  ♦  qh< .  But  then 

i  (b  -  ♦  h^  ]  >  [(b  -  pa^Va^  »qh^],  ana  since  and  qh^ 

are  integer,  f(b  -  4  hj  >  [(b  -  p^JAjJ  *  qh^  hence 

X,  <  a  by  (iv).  When  L  h.c,  > 

1  ~  1  l/k 

last  pArt  of  the  theorem  by  contradiction. 

Proof  of  I'heorem  Assuae  that  for  every  optimal  solution  x* , 

x„  *  >  x,  for  all  i  /  P  ,  ana  x  *  >  x  -  Then  for  every  such  solution, 

1  *  i  q  q  q 

^  for  at  least  one  i  t  (3ay  for  i  •  p)  in  order  to  satisfy 

ax'  <  bo  Lot  x*  specifically  denote  an  optimal  solution  for  which  x  4 

assumes  its  smallest  value.  Then  define  x*  by  x^"  *  x^,*  if  1  /  p  and  i  / 

x  *  *  x  *  «  1»  and  x  "  -  x  *  *  <c  /c  >.  oleariy  ax'  <  ax*,  cx"  >  ex’, 

and  x  <  x  •  <c  /c  >  -  l  <  a  ,  contrary  to  the  assumption  that 

p  -  p  q  p  -  p  J  r 

x  >  x  *  In  any  optimal  solution.  khan  [c  /c,  j  ♦  1  replaces  <c  /c,>. 
p  -  q  4  *  c  l  ^  q'  i 

the  uacond  part  of  tic  theorem  immediately  follows  by  letting  x*  denote 
an}  o pti,.»al  solution  In  which  (1)  ani  (ii)  are  both  false,  ana  noting 
th.t  t.  s  Implies  the  contradiction  oxv  '  ox* 


hkCk' 


ve  obtain  cx  >  cx*,  proving  the 


<i 


Proof  ol'  Theorem  3"  Suppose  that  for  every  optical  solution  x*, 

i.  *  <  x  and  x  ’  <  x,  for  all  i  /  ^  ,  Let  it  further  bo  assumed  that 
P  P  i  ~  i  P 

x*  ijnote;«  an  optimal  elution  in  which  xr  '  assume?  its  largest  value, 

P 

Since  cx*  >  cx  (or  else  x„*  *  would  be  possible,,  >  x<  for  some 


P 


i  f  Q  ^  say  for  3.  »  q.  Hut  than  in  the  solution  x  defined  by 


y  •  y  *  for  i  /  p  and  i  /  q,  x' 
j  1  q 


•'  x  *  ’  1.  and  x  *  *  x  *  4  <c  c  >,. 

q  p  p  q  p 


v»e  have  cx  >  cx*,  ; lx"  <  ax*,  and  x^*  <  a^,  contrary  to  the  assumption 

that  x  <‘  x  "  in  any  optimal  solution  to  11),.  Then  <c  ic  >  la  replaced 
P  P  q  P 

by  Cc  /c  .]  •  l,  the  second  part  of  the  theorem  follows  analogously* 

P  P 

letting  x*  denote  any  optiuial  solution  in  which  (ij  and  Ui)  are  both 
false.*  and  noting  th^.t  cx’’  >  cxm 

Proof  of  Corollary  to  Theorem ,  tote  that  for  p  <  s  and  1  >  s 

a  x  r  1  -  1  **  <c,/c  >f  ar.d  hence  <c.  c  >a  <  a  »  Thun  for  each 
pp  rp-  ip  p  -  l 

p  <  sr  *j  includes  all  a  >  s,  and  there  exists  sn  optimal  solution  x* 

« 

in  which  (i)  x  *>  x  or  (ii)  .x.  *  >  x,  for  some  hence  for  come  i  <  s 

p  ~  p  i  i  p 

bii.ce  (ii)  is  Impossible,  for  each  p  <  s  there  exists  an  optimal  solution 


in  which  x 


tp„  Select  orm  such  p,  say  p  ^  q,  and  replay 


the  variable  x^  by  tne  constant  reducing  the  original  problem  to  & 
new  one.  Clearly  Ire  optimal  solution  to  this  latter  problem  In 
conjunction  with  x^  *  yields  an  optimal  solution  to  the  original 
problem.  Hut  for  the  now  problem,  Theorem  3  again  implies  that  for  each 
refining  p  such  that  p  <(  s,  xq*  -  x^  in  some  optLaai  solution  x*»  Thu® 
wo  may  ropeat  the  process  of  selecting  one  such  p,  denoted  by  q,  and 


assigning  the  variable  x  the  constant  value  x  continuing  until  no  more 

q  q 


I 


lil 


p  remain  which  satisfy  p  <  q.  But  since  >  b  -  ax  for  1  >  s, 

there  is  nc  solution  x*  in  which  x  *  •*  x  for  p  <  s  ana  x  *  >  0  for 

P  P  b  “  i 

i  s.  Pence  x  is  outimal. 

%■ 

Proof  of  Theorem  U»  Suppose  that  for  every  optical  solution  x* ,  x  *  >  h 
and  x  *  <  x  for  all  i  <  o,  Consider  the  problem:  ..axiinize  cx, 
subject  to  ax  <  ax  (•  b  -  G),  and  x^  v  x  for  i  <  s«  In  this  latter 
problem  assume  also  that  is  replaced  by  -  G/h,  .'Since  x^*  >  h 
In  the  original  problem ,  then  the  same  solution  x*  yieias  ax*  <  b  ~  G 
lr  the  raw  problem.  Jut  x  is  optimal  for  the  new  problem  by  Theorem  5 
(proved  beiowy.  Hence  cx  >  cx%  and  x  is  in  fact  optimal  for  the 
original  problem,  contrary  to  the  fact  that  x  *  Q  <  h.  The  last  cart 

n 

of  the  theorem  follows  similarly,  letting  x*  denote  a  single  solution 
for  which  the  theorem  is  supposedly  false,  and  concluding  cx  >  cx*^ 

Proof  of  Theorem  5.  Assa-ne  th^  theorem  false,  and  let  x  denote  &  foeslole 
oolut ion  to  (1)  for  which  cx  >  cx*.  Let  1  denote  the  summation  over 
those  i  for  which  >  x<*,  and  let  £”  denote  the  summation  over  those 
i  for  which  x,  <  x,  *.  Then  cx  **  cx*  •  l"  c,  (x,  -  x  *)  *  £"  c.  (x.,  -  >  *) 

11  111  lil 

•  nai  *  Wn  '  l”  n(\  ••  xi*)ei/ai 

<  (Cp/«^  1'  .jtx,  -  *j‘)  ♦  («j/apJ  2-"  -  O 

•  ^Cr/fi  /  ^ax  ax*;,  since  from  the  definition  of  x.*  it  follows  that. 

all  i  associated  with  hv  satisfy  i  <  p,  and  all  i  associated  with  1" 

satisfy  5,  >  p-  But  ax‘  r  ..  a. a  ♦  a  (o  -  1  a,x)/a  *»  b. 

KP  1  5  P  i<p  *  J  P 

and  hence  ax  -  rot*  <  0  Thus  cx  -  cx*  <  C,  contrary  to  asaiuiption. 

Proof  of  Theore-;.  (**  .  e  note  that  1  x  *  •  H,  ;^*  <  3.  for  all  ia 

i  <  n  1 


l  V 


and  tn&t  !  a  x/4  <  a  H  <  a  k  <  b,  where  a  a  ttax(ft.  ) 
i<«M  i  1 

ac  riU  «  of  the  snbscri  oted  inaaxing,  1  c.x,  <  1 

1  <  n  l<n 

solution  x  such  th?t  «■  x,  <  H*  Clearly  1  x.  < 

i  <  n  1  <  r.  1 

feasible.  Hence  it  rwns  to  sho'A  only  that  Z  J.  < 

i  -  l  •“ 
1  V  II 

solution  x.  Supoosc  on  the  contrary  tiiat  c  x<  >  k  ♦ 

i  <  n‘  ~ 

a  s  rain  (a  }.  Then  Z  ax,  >  a  ^  x,  >  &  Oc  *  1 

p  i'  .  11“  Pi  .  i  ’*  P 


i  r 


i  <  I. 


which  is  impossible. 


rrcu  ci  the  Conoid  ^ny  t Tp.y or  s..,  o.  The  corollary  is  a 
of  the  theorem. 


.  Lrue  to  the 

c  x^*  for  ejxy 

L  if  x  is 
<  n 

ma 

k  fer  any  feasible 
1,  and  let 

)  >  bP 

special  case 
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